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(54) Robot ambulation control apparatus and method 

(57) The stability of attitude of a robot can be recov- 
ered by an ambulation control apparatus and an ambu- 
lation control method if it is lost in the course of a 
gesture for which the upper limbs take a major role. The 
apparatus and the method obtain the pattern of move- 
ment of the entire body for walking by deriving the pat- 
tern of movement of the loins from an arbitrarily 
selected pattern of movement of the feet, the trajectory 
of the ZMP, the pattern of movement of the trunk and 
that of the upper limbs. A robot can determine the gait 
of the lower limbs so as to realize a stable walk regard- 
less if the robot is standing upright or walking. Particu- 
larly, if the robot is made to gesture, using the upper 
body half including the upper limbs and the trunk while 
standing upright, it can determine the gait of the lower 
limbs so as to make a stable walk in response to such a 
gait of the upper body half. 
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Description 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

[0001] This invention relates to an ambulation control apparatus and an ambulation control method for controlling 

a robot. 

10 Description of Related Art 

[0002] A robot refers to a mechanical apparatus that moves like man, utilizing electric and/or magnetic effects. The 
word "robot" is believed to be originating from a Slavic word "ROBOTA (slave machine)". Robots became popular in 
Japan in the late nineteen sixties but many of them were industrial robots designed for the purpose of automation and 

75 manpower-saving in factories including manipulators and carrier robots. 

[0003] As a result of massive research and development efforts in recent years in the field of bipedal ambulatory 
robots having a structure that resembles the bodily mechanism and the motion of an erect bipedal animal such as man 
or ape, robots are expected than ever to find practical applications. The bipedal ambulatory robot adapted to erect bipe- 
dalism has an advantage that it can softly walk, getting over an obstacle and stepping up and down a staircase without 

20 difficulty. 

[0004] It should be noted here, however, that the research and development of bipedal ambulatory robot historically 
started from studies on various aspects of motion of lower limbs and was not directed to entire erect bipeds. 
[0005] For instance, Japanese Patent Application Laid-Open No. 3-184782 discloses a joint applicable to a struc- 
ture corresponding to from -the -torso- down of a bipedal ambulatory robot. 

25 [0006] Japanese Patent Application Laid-Open No. 5-305579 discloses an ambulation control apparatus of a 
bipedal ambulatory robot. An ambulation controi apparatus according to the above patent document is adapted to con- 
trol a bipedal ambulatory robot in such a way that the ZMP (zero moment point) of the robot on the floor where the robot 
is walking agrees with a target position. The zero moment point is a point on the floor where the moment of the robot 
due to the reaction of the floor is equal to nil. However, it is clear from FIG. 1 of the above patent document that the torso 

30 24 that gives rise to the moment is a sort of black box and the document proposes only lower limbs of a bipedal ambu- 
latory robot and not an entire robot that mimics man. 

[0007] However, to many researchers, obviously the ultimate object of research and development of bipedal ambu- 
latory robots is realization of a structure that looks like and moves like man. To be more accurate, a bipedal ambulatory 
robot is a structure adapted to erect bipedalims and having lower limbs good for walking on its two feet, an upper half 
35 of the body including a torso, a head and arms (hereinafter to be referred to simply as upper limbs) and a trunk section 
linking the upper limbs and the lower limbs. A complete robot should be so controlled that it stands upright and walks 
and works on its two feet, moving the upper limbs, the lower limbs and the trunk section in a coordinated manner 
according to a predetermined priority scheme. 

[0008] A bipedal ambulatory robot that simulates man in terms of motion and bodily structure is referred to as 
40 humanoid robot. A humanoid robot can support our daily lives in various scenes of living. 

[0009] Bipedal ambulatory robots can be roughly categorized into those to be used for industry and those to be 
used for entertainment. 

[0010] Robots for industrial applications are mostly designed to replace men in various different industrial scenes 
and do difficult works for men in the field of manufacturing, construction, power generation and so on. For example, 

45 robots of this category replace men in atomic power plants, thermal power plants, petrochemical plants and other plants 
for maintenance works and in manufacturing factories and sky-scraping buildings for various dangerous and difficult 
works. Thus, robots of this category are so designed and manufactured as to operate for a specific application or func- 
tion in a specific way, although they walk on two feet. In other words, they are not required to have a structure that mim- 
ics the bodily mechanism and the motion of an erect bipedal animal such as man or ape. For instance, while they may 

so show high degrees of freedom at a specific part of the body in order to work for a specific application by moving in a 
delicate way, the degrees of freedom of other parts of the body that are not directly related to the application such as 
head and waist may be left low. As a result, inevitably, such robots may move awkwardly and may not appear particu- 
larly agreeable. 

[0011] On the other hand, robots for entertainment are more closely related to our daily lives rather than adapted 
55 to carry out difficult works and supporting our lives. In other words, robots of this category are designed to copy the 
physical mechanism of erect bipedalism of men and apes and move smoothly. As they are a sort of copies of erect 
mammals such as men and apes who are highly intelligent, they are preferably rich in expressions. In this sense, they 
are exactly humanoid robots. 
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[0012] In short, while robots for entertainment share the essential technologies with those for industrial applica- 
tions, they are totally different from each other in terms of hardware mechanism, method of controlling motions and soft- 
ware configuration for achieving the ultimate object. 

[0013] As well known, the human body has joints whose number exceeds several hundreds and hence shows sev- 
s eral hundred degrees of freedom. While a robot preferably shows the same degrees of freedom if it mimics perfectly the 
behaviour of man, to achieve such high degrees of freedom is technologically highly difficult because a single degree 
of freedom requires the use of an actuator but a robot provided with hundreds of actuators is totaJiy impractical in terms 
of manufacturing cost, weight and size. Additionally, a robot with high degrees of freedom requires a volume of compu- 
tation that increases exponentially for controlling the position, action and balance. 
ic [0014] To summarize, a humanoid robot has to be designed to emulate the bodily mechanism of man with limited 
degrees of freedom. Additionally, a robot for entertainment is required to behave like man and be rich in expressions 
with degrees of freedom far lower than the human body. 

[0015] Additionally, while a bipedal ambulatory robot adapted to erect bipedalism can softly walk, getting over an 
obstacle and stepping up and down a staircase without difficulty, the operation of controlling its attitude and walk is dif- 
15 ficult because its center of gravity is rather high. Particularly, a robot for entertainment should be so controlled for its 
attitude and stable walk that it remains rich in expressions. 

[001 6] Meanwhile, the "expression" of man or ape heavily relies on the motion of the upper limbs including the arms 
and the torso in terms of not only carrying out a work but also manifesting its feeling. Such a motion is referred to as 
"gesture". 

20 [0017] In our daily lives, gestures appear almost constantly on our bodies while we are standing or walking or oth- 
erwise moving on our feet. Additionally, the center of gravity the entire body of a person moves significantly to give rise 
to the moment of inertia while he or she is gesturing. Men and apes are so created that they can keep on standing or 
walking by autonomously compensating the balance of the center of gravity and the moment of inertia. 
[0018] On the other hand, a humanoid robot is required to be rich in expressions as pointed out above and hence 

25 gestures are indispensable to it. Therefore, the robot needs attitude control and stable walk control in response to a 
gesture for which the upper half of the body takes a major role. 

[0019] A number of techniques have been proposed for controlling a bipedal ambulatory robot in terms of attitude 
and stable walk. However, most of the known techniques are those adapted to make the ZMP (zero moment point) of 
the robot where the moment of the robot due to the reaction of the floor is equal to nil agrees with a target position. 
30 [0020] For example, Japanese Patent Application Laid-Open No. 5-305579 discloses a bipedal ambulatory robot 
that is controlled in such a way that the ZMP of the robot on the floor where the robot is walking agrees with a target 
position. 

[0021] Additionally, the bipedal ambulatory robot of Japanese Patent Application Laid-Open No. 5-305581 is so 
configured that the ZMP is located in the inside of the supporting polyhedron or at a position separated from the ends 
35 of the supporting polyhedron of the robot by a predetermined margin when one of the feet of the robot touches down 
on or lifts off from the floor. With this arrangement, the robot can maintain its stability of walking if subjected to external 
disturbances because of its safety margin of a predetermined distance. 

[0022] Japanese Patent Application Laid-Open No. 5-305583 also discloses a technique of controlling the walking 
speed of the bipedal ambulatory robot by way of ZMP target position. More specifically, the bipedal ambulatory robot of 

40 the above patent document uses preselected walk pattern data and the leg joints of the robot are so driven as to make 
the ZMP agree with a target position, while the inclination of the upper half of the body is detected, so that the rate of 
delivering the preselected walk pattern data is modified according to the detected value of inclination. As a result, if the 
robot rides on unexpected undulations of the floor and becomes forwardly inclined, the rate of delivering the preselected 
walk pattern data is raised to allow the robot to restore the proper attitude. Additionally, since the ZMP is so controlled 

45 as to agree with a target position, there arises no problem if the rate of delivering the preselected walk pattern data is 
modified when the robot is standing on its two feet. 

[0023] Still additionally, the Japanese Patent Application Laid-Open No. 5-305585 discloses a technique of control- 
ling the touch down position of either of the two feet of the bipedal ambulatory robot according to the target position of 
the ZMP More specifically, the bipedal ambulatory robot of the above patent document either detects the discrepancy 
so between the target position and the actually detected position of the ZMP and drives one or both of the legs to eliminate 
the discrepancy or detects the moment around the ZMP target position and drives the legs so as to make the detected 
moment equal to zero. 

[0024] Furthermore, the Japanese Patent Application Laid-Open No. 5-305586 describes a technique of controlling 
the inclined attitude of the bipedal ambulatory robot by way of the ZMP target position. More specifically, the bipedal 
55 ambulatory robot of the above patent document detects the moment around the ZMP target position and, if any moment 
is detected, it drives the legs so as to make the detected moment equal to zero for stable walk. 

[0025] Besides, known documents including "The Data Book of Bipedal Ambulatory Robots", (2nd edition), A Gen- 
eral Study (A) Subsidized by the Ministry of Education, "A Study on Ambulation and Control of a Bipedal Ambulatory 
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Robot", Research Group (February, 1986) and "The Development of a Bipedal Ambulatory Robot Adapted to Compen- 
sate the Tri-Axial Moment by a Motion of the Upper Limbs" (6th Symposium on Intelligent Moving Robots, May 21 and 
22, 1 992) describe bipedal ambulatory robots comprising at least upper limb joints for driving the upper limbs and a plu- 
rality of leg joints linked to the upper limbs and adapted to drive the leg joints for walking, wherein the gait of the upper 
5 limbs is determined on the basis of that of the lower limbs (and hence any instability of the attitude of the robot due to 
the motion of the legs is corrected by the gait of the upper limbs). 

[0026] Thus, the above pointed out known techniques are not adapted to control the attitude and the stability of 
walking of the robot by taking motions where the upper limbs of the robot takes a major role into consideration. In other 
words, the above techniques are for recovering the stability of walking of a bipedal ambulatory robot by modifying the 

10 attitude of its upper limbs (and their motion that changes with time) when the robot can no longer keep on walking due 
to external disturbance. Differently stated, those techniques are intended to modify the attitude of the upper limbs of a 
robot where the lower limbs takes a major role in walking in order to correct their instability due to external disturbances 
so that the techniques neglect the expression of the upper limbs. Additionally, the techniques described in the above 
documents cannot recover the stability of attitude if it is lost in the course of a gesture for which the upper limbs take a 

is major role. 

[0027] An embodiment of the present invention seeks to provide an ambulation control apparatus and an ambula- 
tion control method for effectively controlling a robot having a structure that is adapted to mimic the mechanism and the 
behaviour of a living body. 

[0028] Another embodiment of the present invention seeks to provide an ambulation control apparatus and an 
20 ambulation control method for effectively controlling a bipedal ambulatory robot having a structure that is adapted to 
mimic the mechanism and the behaviour of an erect biped such as man or ape. 

[0029] Still another embodiment of the present invention seeks to provide an ambulation control apparatus and an 
ambulation control method for effectively controlling an erect bipedal ambulatory robot having lower limbs adapted to 
erect bipedaiism and amounted with an upper body half including a torso, a head and arms. 
25 [0030] Still another embodiment of the present invention seeks to provide an ambulation control apparatus and an 
ambulation control method for effectively controlling a robot so as to make it walk stably and keep on behaving like a 
man and being rich in expressions. 

[0031] A further embodiment of the present invention seeks to provide an ambulation control apparatus and an 
ambulation control method for effectively controlling an erect bipedal ambulatory robot having lower limbs adapted to 
30 erect bipedaiism and amounted with an upper body half including a torso, a head and arms so as to make it recover the 
stability of attitude whenever the latter is lost due to an action of gesture or some other expression where the upper 
body half takes a major role. 

[0032] A still further embodiment of the present invention seeks to provide an ambulation control apparatus and an 
ambulation control method for effectively controlling an erect bipedal ambulatory robot so as to make it determine its 
35 gait of the lower limbs in response to that of the upper limbs (the term "gait" as used herein is a technical term of the 
industry referring to "time series changes of the angles of joints" and having a meaning substantially same as "pattern 
of movement"). 

[0033] Embodiments of the invention seek to provide a robot having a structure adapted to behave like a living body 
with an enhanced level of reality. More particularly, an embodiment relates to an ambulation control apparatus and an 
40 ambulation control method to be used for a bipedal ambulatory robot having a structure that mimics the bodily mecha- 
nism and the motion of an erect bipedal animal such as man or ape. 

[0034] An embodiment of the present invention relates to an ambulation control apparatus and an ambulation con- 
trol method to be used for a bipedal ambulatory robot adapted to erect bipedaiism and having the upper half of the body 
including the torso, the head and the arms mounted on the lower limbs. More particularly, the embodiment relates to an 
45 ambulation control apparatus and an ambulation control method to be used for a robot that mimics the motion of man 
including gestures with startling reality and walks on its two legs without losing balance. 

BRIEF SUMMARY OF THE INVENTION 

50 [0035] According to one aspect of the invention, there is provided an ambulation control apparatus or an ambulation 
control method for controlling a robot of the type having at least lower limbs, a trunk and loins and adapted to bipedai- 
ism, said apparatus or method being adapted to obtain the pattern of movement of the entire body for walking by deriv- 
ing the pattern of movement of the loins from an arbitrarily selected pattern of movement of the feet, the trajectory of 
the ZMP, the pattern of movement of the trunk and that of the upper limbs. 

55 [0036] In a second aspect of the invention, there is provided an ambulation control apparatus or an ambulation con- 
trol method for controlling a robot of the type having at least lower limbs, a trunk and loins so as to make it move on its 
two feet of the lower limbs in order to cause the ZMP to get to a target position, said apparatus or method comprising: 
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(a) a means for or a step of selecting the motion of the feet, that of the trunk and that of the upper limbs and the 
attitude and height of the loins in order to realize a requested action; 

(b) a means for or a step of selecting the trajectory of the ZMP on the basis of the motion of the feet selected by 
said means or in said step (a); 

s (c) a means for or a step of obtaining a solution for the motion of the loins for balancing the moment on the ZMP 

selected by said means or in said step (b); and 

(d) a means for or a step of realizing the motion of the loins on the basis of the obtained solution for the motion of 
the loins 

10 [0037] In a third aspect of the invention, there is provided an ambulation control apparatus or an ambulation control 
method for controlling a robot of the type having at least lower limbs, a trunk and loins so as to make it move on its two 
feet of the lower limbs in order to cause the ZMP to get to a target position, said apparatus or method comprising: 

(A) a means for or a step of selecting the motion of the feet, that of the trunk and that of the upper limbs and the 
75 attitude and height of the loins in order to realize a requested action; 

(B) a means for or a step of selecting the trajectory of the ZMP on the basis of the motion of the feet selected by 
said means or in said step (A); 

(C) a means for or a step of obtaining an approximate solution for the motion of the loins for balancing the moment 
on the ZMP selected by said means or in said step (B) by means of a non-strict model; 

20 (D) a means for or a step of obtaining an approximate solution for the motion of the loins for balancing the moment 

on the ZMP selected by said means or in said step (B) by means of a non-strict model; 

(E) a means for or a step of finalizing the solution for the motion of the loins when the difference between the 
approximate solution obtained by said means or in said step (C) and the approximate solution obtained by said 
means or in said step (D) is less than a predetermined admissible value; 
25 (F) a means for or a step of modifying the moment on the ZMP of the non-strict model and inputting the modified 

value to said means or step (C) when the difference between the approximate solution obtained by said means or 
in said step (C) and the approximate solution obtained by said means or in said step (D) is not less than the prede- 
termined admissible value; and 

(G) a means for or a step of realizing the motion of the loins on the basis of the obtained solution for the motion of 
30 the loins. 

[0038] The non-strict model in an ambulation control apparatus or an ambulation control method according to the 
third aspect of the invention may be a linear and/or non-interference multiple materia! point approximation model for 
robots. On the other hand, the strict model in an ambulation control apparatus or an ambulation control method accord- 
35 ing to the third aspect of the invention may be a rigid body model or a non-linear and/or interference approximation 
model of a multiple material point system. 

[0039] An ambulation control apparatus or an ambulation control method according to the third aspect of the inven- 
tion may further comprises (C) a means for or a step of rese lectin g/modifying the pattern of movement of the trunk and 
that of the upper limbs when the selected motion of the trunk and that of the upper lirnbs cannot be realized by the 
40 approximate solution obtained by said means for or in said step of, whichever appropriate, obtaining an approximate 
solution for the motion of the loins by means of a non-strict model (C). 

[0040] Said means for or said step of obtaining an approximate solution for the motion of the loins by means of a 
non-strict model (C) of an ambulation control apparatus or an ambulation control method according to the third aspect 
of the invention may be a means for or a step of, whichever appropriate, obtaining an approximate solution for the 
45 motion of the loins by solving a balancing equation of the moment on the selected ZMP generated by the motions of the 
feet, the trunk and the upper limbs and the moment on the selected ZMP generated by the horizontal plane motion of 
the loins. 

[0041] Alternatively, said means for or said step of obtaining an approximate solution for the motion of the loins by 
means of a non-strict model (C) may be a means for or a step of, whichever appropriate, replacing the time function with 

so a frequency function for computation. 

[0042] Still alternatively, said means for or said step of obtaining an approximate solution for the motion of the loins 
by means of a non-strict model (C) may be a means for or a step of, whichever appropriate, computationally determining 
the Fourier coefficients of the horizontal plane trajectory of the loins by applying a Fourier series development to the 
moment on the selected ZMP generated by the motions of the feet, the trunk and the upper limbs and also to the hori- 

55 zontal plane trajectory of the loins and additionally obtaining an approximate solution of the motion of the loins by apply- 
ing an inverse Fourier series development. 

[0043] In a fourth aspect of the invention, there is also provided an ambulation control apparatus or an ambulation 
control method for controlling a robot of the type having an upper body half provided with a plurality of joints for express- 
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ing an action of the upper body half and a lower body half having leg joints at least for realizing an ambulatory action, 
the gait of the lower body half adapted to stable walk being determined according to the gait of the upper body half. 
[0044] Thus, an ambulation control apparatus or an ambulation control method according to an embodiment of the 
invention can realize the motion of the loins of a robot adapted to stable walk on the basis of a selected pattern of move- 
5 ment of the trunk and that of the upper limbs in addition to that of the feet. The motion of the trunk and that of the upper 
limbs correspond to the gait of the upper body half that is an action of expression including gestures that uses the upper 
body half. 

[0045] According to an embodiment of the invention, a robot can determine the gait of the lower limbs so as to real- 
ize a stable walk regardless if the robot is standing upright or walking. Particularly, if the robot is made to gesture, using 
10 the upper body half including the upper limbs and the trunk while standing upright, it can determine the gait of the lower 
limbs so as to make a stable walk in response to such a gait of the upper body half. 

[0046] According to the invention, there is provided an ambulation control apparatus and an ambulation control 
method for effectively controlling a robot having a structure that is adapted to mimic the mechanism and the behaviour 
of a living body. 

15 [0047] Additionally, according to the present invention, there is also provided an ambulation control apparatus and 
an ambulation control method for effectively controlling a bipedal ambulatory robot having a structure that is adapted to 
mimic the mechanism and the behaviour of an erect biped such as man or ape. 

[0048] Still additionally, according to the present invention, there is also provided an ambulation control apparatus 
and an ambulation control method for effectively controlling an erect bipedal ambulatory robot having lower limbs 
20 adapted to erect bipedalism and amounted with an upper body half including a torso, a head and arms. 

[0049] Still additionally, according to the present invention, there is also provided an ambulation control apparatus 
and an ambulation control method for effectively controlling a robot so as to make it walk stably and keep on behaving 
like a man and being rich in expressions. 

[0050] Still additionally, according to the present invention, there is also provided an ambulation control apparatus 
25 and an ambulation control method for effectively controlling an erect bipedal ambulatory robot having lower limbs 
adapted to erect bipedalism and amounted with an upper body half including a torso, a head and arms so as to make 
it recover the stability of attitude whenever the latter is lost due to an action of gesture or some other expression where 
the upper half of the body takes a major role. 

[0051] Furthermore, according to the present invention, it is now possible to provide a robot adapted to erect bipe- 
30 dalism and designed to generate a pattern of movement of the loins to generate a corresponding pattern of stable 
motion of the lower half of the body which may be from -the -trunk- down (or from-the-loins-down). Therefore, if the atti- 
tudinal stability of the robot is lost due to an expression such as gesture led by the upper body half, it can be recovered 
by an appropriate motion of the lower half of the body. 

[0052] In the case of a bipedal ambulatory robot having six degrees of freedom at each lower limb, the attitude of 
35 each leg is unequivocally determined by the position of the corresponding foot and the height of the corresponding loin. 
In other words, the generation of a pattern of movement of the loin means that the attitude of the leg and hence the gait 
of the lower limb is determined by it. Thus, with an ambulation control apparatus or an ambulation control method 
according to an embodiment of the invention, it is possible to determine the gait of the lower body half that is adapted 
to stable bipedalism in response to the gait of the upper body half. 

40 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0053] For a better understanding of the present invention, reference will now be made by way of example to the 

accompanying drawings in which: 

45 

FIG. 1 is a schematic perspective front view of an illustrative humanoid robot 100 to which an illustrative embodi- 
ment of the present invention is applicable. 

FIG. 2 is a schematic perspective rear view of the humanoid robot of FIG. 1 . 

FIG. 3 is a schematic illustration of the humanoid robot 100 of FIG. 1, showing the model of degrees of freedom 
so applied to it. 

FIG. 4 is a schematic illustration of an illustrative humanoid robot 100 to which an illustrative embodiment of the 
present invention is applicable, showing the control system thereof. 

FIG. 5 is a schematic illustration of the linear and non-interference multiple material point approximation model 
applied to a humanoid robot 100 in order to control the walk thereof. 
55 FIG. 6 is a flow chart of an illustrative sequence of operation for controlling the walk of a humanoid robot 100 

according to the invention. 

FIG. 7 is a flow chart of another illustrative sequence of operation for controlling the motion of the loins adapted to 
stable walk of a humanoid robot 100. 
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FIG. 8 is an enlarged schematic perspective view of the multiple material point model of FIG. 5, illustrating the loins 
and the vicinity thereof. 

FIG. 9 is a schematic illustration of a humanoid robot, showing the configuration of its joint model. 

FIG. 1 0 is a schematic illustration of aother humanoid robot, showing the configuration of its joint model. 

5 

DETAILED DESCRIPTION OF THE INVENTION 

[0054] Now, the present invention will be described in greater detail by referring to the accompanying drawings, 
which show illustrative embodiments of the invention. 

10 [0055] FIGS. 1 and 2 are schematic perspective view of an illustrative humanoid robot 100 to which an illustrative 
embodiment of the present invention is applicable, illustrating a front view and a rear view respectively. FIG. 3 is a sche- 
matic illustration of the humanoid robot 100 of FIG. 1, showing the model of degrees of freedom applied to it. 
[0056] As shown in FIG. 3, the humanoid robot 100 comprises body half including a pair of arms and a head 1, a 
lower body half including a pair of legs for realizing a walking action and a trunk linking the upper limbs and lower limbs. 

15 [0057] The neck joint supporting the head 1 has three degrees of freedom of a neck joint yawing axis 2, aneckjoint 
pitching axis 3 and a neck joint rolling axis 4. 

[0058] Each of the upper limbs comprises a shoulder joint pitching axis 8, a shoulder joint rolling axis 9, an upper 
arm yawing axis 1 0, an elbow joint pitching axis 1 1 , a forearm yawing axis 12, a wrist joint pitching axis 13, a wrist joint 
rolling axis 14 and a hand 15. The hand 15 of man is in fact a multiple joint and multiple degree of freedom structure 
20 having a plurality of fingers. However, since the action of the hand 15 exerts little effect on the attitude control and the 
ambulation control of the robot 1 00, it is assumed here to have zero degrees of freedom. Thus, each of the upper limbs 
has seven degrees of freedom. 

[0059] The trunk has three degrees of freedom of a trunk pitching axis 5, a trunk rolling axis 6 and a trunk yawing 

axis 7. 

25 [0060] Each of the lower limbs comprises a hip joint yawing axis 16, a hip joint pitching axis 1 7, a hip joint rolling 
axis 1 8, a knee joint pitching axis 19, an ankle joint pitching axis 20, an ankle joint rolling axis 21 and a foot 22. For the 
purpose of this embodiment, the point of intersection of the hip joint pitching axis 17 and the hip joint rolling axis 18 
defines the position of the hip joint. While the foot 22 of man is in fact a multiple joint and multiple degree of freedom 
structure including a sole, the sole of the humanoid robot 100 has zero degrees of freedom for the purpose of the 

30 embodiment. Thus, each of the lower limbs has six degrees of freedom. 

[0061] Alt in all, the humanoid robot 1 00 of this embodiment has a total of 3 + 7x2 + 3 + 6x2 = 32 (thirty two) 
degrees of freedom. However, note that the degrees of freedom of humanoid robots 10O designed for the purpose of 
entertainment are by no means not limited to thirty two. It may be needless to say that the degrees of freedom and 
hence the number of joints of a robot should be determined appropriately depending on various limitations and require- 

35 ments particularly in terms of design and manufacture. 

[0062] The degrees of freedom of the humanoid robot 100 are realized in reality by so many actuators mounted on 
the robot. The actuators are preferably small and lightweight from the viewpoint that the robot is an unstable bipedal 
structure, requiring rigorous attitude control, although it looks like and behave like a man. For the purpose of this 
embodiment, small AC servo actuators of the type where the gears are directly linked and the servo control system is 

40 realized in the form a single chip that is contained in a motor unit. Note that such an AC servo actuator is known and 
described, for example, in Japanese Patent Application Laid-Open No. 11-33386, which is assigned to the applicant of 
the present patent application. 

[0063] FIG. 4 is a schematic illustration of an illustrative humanoid robot 1 00 to which an illustrative embodiment of 
the present invention is applicable, showing the control system thereof. As shown, the humanoid robot 100 comprises 
45 mechanical units 30, 40, 50R/L and 60R./L that correspond to respective parts of the human body and a control unit 80 
for controlling the motions of the mechanical units in a coordinated manner (R and L being suffixes for indicating right 
and left respectively as used herein). 

[0064] The entire motion of the humanoid robot 100 is controlled by the control unit 80. The control unit 80 com- 
prises a main control unit 81 containing a CPU (central processing unit), memories and other major circuit components 
50 (not shown) and a peripheral circuit 82 containing a power source circuit (not shown) and interfaces (not shown) to be 
used for the exchange of data and command between related circuit components. 

[0065] The control unit 80 may be installed at any appropriate position. While it is mounted in the trunk unit 40 in 
FIG. 4, it may alternatively be mounted in the head unit 30. Still alternatively, the control unit 80 may be arranged outside 
the robot 1 00 so that it may communicate with the robot 1 00 main body by way of a wired or radio communication chan- 
55 nel. 

[0066] The degrees of freedom of each of the joints of the robot 1 00 shown in FIG. 3 are realized by so many cor- 
responding actuators. More specifically, the head unit 30 is provided with a neck joint yawing axis actuator A 2 , a neck 
joint pitching axis actuator A 3 and a neck joint rolling axis actuator A 4 respectively for the neck joint yawing axis 2, the 
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neck joint pitching axis 3 and the neck joint rolling axis 4. 

[0067] On the other hand, the trunk unit 40 is provided with a trunk pitching axis actuator A 5 , a trunk rolling axis 
actuator A 6 and trunk yawing axis actuator A 7 respectively for the trunk pitching axis 5, the trunk rolling axis 6 and the 
trunk yawing axis 7. 

5 [0068] Meanwhile, each of the arm units 50R/L that comprise upper arm units 51 R/L, elbow joint units 52R/L and 
forearm unit 53R/L is provided with a shoulder joint pitching axis actuator A 8 , a shoulder joint rolling axis actuator A 9 , 
an upper arm yawing axis actuator A 10t an elbow joint pitching axis actuator A 11t an elbow joint rolling axis actuator A 12> 
a wrist joint pitching axis actuator A 13 and a wrist joint rolling axis actuator A 14 respectively for the shoulder joint pitching 
axis 8, the shoulder joint rolling axis 9, the upper arm yawing axis 1 0, the elbow joint pitching axis 1 1 , the elbow joint 

io rolling axis 12, the wrist joint pitching axis 13 and the wrist joint rolling axis 14. 

[0069] Each of the leg units 60R/L that comprise thigh units 61 R/L, knee units 62R/L and shank units 63R/L is pro- 
vided with a hip joint yawing axis actuator A 16 , a hip joint pitching axis actuator A 17 , a hip joint rolling axis actuator A 18 , 
a knee joint pitching axis actuator A 19 , an ankle joint pitching axis actuator A 2 o and an ankle joint rolling axis actuator 
A 21 respectively for the hip joint yawing axis 1 6, the hip joint pitching axis 1 7, the hip joint rolling axis 1 8, the knee joint 

75 pitching axis 1 9, the ankle joint pitching axis 20 and the ankle joint rolling axis 21 . 

[0070] The actuators A 2 , A 3 , ... provided for the respective joints are preferably small AC servo actuators of the type 
where the gears are directly linked and the servo control system is realized in the form a single chip that is contained in 
a motor unit. 

[0071] The mechanical units including the head unit 30, the trunk unit 40,the arm units 50R/L and the leg units 
20 60R/L are provided with respective auxiliary control sections 35, 45, 55R/L and 65R/L for driving/controlling the actua- 
tors for which they are responsible. The robot is additionally provided with touch down confirmation sensors 91 and 92 
for detecting the if e Ither or both of the soles of the right and left leg units 60R/L touched down or not and an attitude 
sensor 93 is arranged in the trunk unit 40 to detect the attitude of the robot. 

[0072] The main control section 80 appropriately controls the auxiliary control sections 35, 45, 55 and 65 in 
25 response to the outputs of the sensors 91 through 93 to cause the humanoid robot 100 to move its upper limbs, trunk 
and lower limbs in a concerted manner. The main control section 81 selects the motion of the feet, the trajectory of the 
ZMP (zero moment point), the motion of the trunk, that of the upper limbs and the height of the loins and transfers com- 
mands necessary for the selected motions to the auxiliary control sections 35, 45, 55 and 65. Upon receiving the com- 
mands, the auxiliary control sections output drive control signals to the respective actuators A 2 , A 3 , ... in response to 
30 the commands they receives from the main control section 81 . The term "ZMP" as used herein refers to a point on the 
floor where the moment of the robot due to the reaction of the floor is equal to nil. The expression "ZMP trajectory" as 
used herein refers to the trajectory along which the ZMP moves while the robot 100 is walking. 

[0073] With this embodiment, the humanoid robot 1 00 physically having the degrees of freedom as shown in FIG. 
3 is replaced by a multiple material point approximation model to computationally control the ambulation of the robot. 
35 While the humanoid robot 100 is an aggregate of infinite continuous material points, the volume of computations nec- 
essary for controlling the ambulation of the robot can be reduced by replacing it with an approximation model compris- 
ing finite and discrete material points. 

[0074] FIG. 5 is a schematic illustration of the linear and non-interference multiple material point approximation 
model applied to a humanoid robot 1 00 in order to control the walk thereof for the purpose of this embodiment. 

40 [0075] Referring to FIG. 5, the O-XYZ coordinate system shows the axes of rolling, pitching and yawing in the abso- 
lute coordinate system, whereas the O-X'Y'Z' coordinate system shows the axes of rolling, pitching and yawing in the 
moving coordinate system that moves with the robot 100. In the case of the multiple material point model of FIG. 5, i 
denotes the i-th material point. Therefore, mi denote the mass of the i-th material point and r'j denotes the position vec- 
tor of the i-th material point (in the moving coordinate system). The mass of the material point of the loins that is impor- 

45 tant for controlling the motion of the loins as will be discussed hereinafter is denoted by m h and its position vector is 
denoted by r' h (r" hx , r* hy , r' hz ), whereas the position vector of the ZMP is denoted by r* zrnp . 

[0076] In the case of the non-strict multiple material point approximation model of FIG. 5, the formula of moment is 
described in the form of linear equation and hence does not interfere with the pitching axis and the rolling axis. 
[0077] Such a multiple material point approximation model can be generated in a manner as generally described 

50 below. 

(1) Determine the mass distribution of the entire robot 100. 

(2) Select material points. Material points may be selected manually according to the inputs of the designer or auto- 
matically according to a predetermined rule. 

5*. (3) Determine the center of gravity of each region (material point) i and assign the center of gravity and the mass 

mj to the material point. 

(4) Express each material point mj as a sphere having its center at the material point rj and its radius proportional 
to its mass. 
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(5) Link the spheres, or the material points, that are linked in reality. 

[0078] A multiple material point model represents the robot in the form of a wireframe model. In the multiple mate- 
rial point approximation model of FIG. 5, the shoulders, the elbows, the wrists, the trunk, the loins and the ankles are 

5 selected as magnetic tape points. 

[0079] The angles of rotation (6 hx , G hy , G hz ) in the loins information of the multiple material point approximation 
model of FIG. 5 define the attitude of the loins of the humanoid robot 100 in terms of rolling axis, pitching axis and yaw- 
ing axis (see FIG. 8 that is an enlarged schematic perspective view of the multiple material point model of FIG. 5, illus- 
trating the loins and the vicinity thereof). 

io [0080] Now, the operation of control the ambulation of the humanoid robot 100 of this embodiment will be discussed 
below. 

[0081] A robot is normally so designed that its joints, or the actuators, are driven in a controlled manner according 
to a motion pattern generated in advance before it actually move. In the case of the robot 100 of this embodiment, a 
loins motion pattern that allows the robot to stably walk is generated on the basis of a feet motion pattern, a ZMP tra- 
15 jectory a trunk motion pattern, an upper limbs motion pattern and other patterns, which can be arbitrarily selected. The 
ZMP as used herein refers to a point where the sole of one of the feet of the robot is rigidly secured to the floor without 
generating any moment when the robot is walking. 

[0082] In the case of the bipedal ambulatory robot, each of whose legs has six degrees of freedom (see FIG. 3), 
the attitude of the legs is unequivocally defined by the positions of the feet 22R/L and the horizontal position and the 
20 height of the loins. Therefore, the generation of the loins motion pattern is in fact the selection of the attitude of the legs, 
or the "gait" of the lower limbs (the term "gait" as used herein is a technical term of the industry referring to "time series 
changes of the angles of joints" and having a meaning substantially same as "pattern of movement"). 
[0083] FIG. 6 is a flow chart of a sequence of operation for controlling the walk of a humanoid robot 1 00. Note that 
the motion and the position of each of the joints of the robot 1 00 are described hereinafter by using the linear and non- 
25 interference multiple material point approximation mode! of FIG. 5 and the following parameters as listed below. Note 
that the symbols with a Dash (') describe the moving coordinate system. 

[mathematical expressions 1] 

30 [0084] 

m h : mass of the material point of the loins 

Hhi^hxi r 'hy> t*hz) : position vector of the material point of the loins 

35 

nij: mass of the i-th material point 
r> : position vector of the i-th material point 
40 tzmp : position vector of the ZMP 

g(9x>9y>9z) : gravity acceleration vector 

O'-X'Y'Z': moving coordinate system (that moves with the robot) 

45 

OXYZ: absolute coordinate system 



[0085] It is assumed that the loins of the robot 1 00 shows a constant height (r 1 h2 + r qz = constant) and the material 
point of each of the knees is equal to zero. 

[0086] The sequence of operation of FIG. 6 starts when a user command is input for an action of the robot 100, 
55 which may be a walking motion or a gesture. The action of the robot 100 as directed by the user command may be a 
gesture using the upper limbs and the trunk when the robot is standing upright, a walk on the two feet or a gesture using 
the upper limbs and the trunk when the robot is walking on the two feet to name a few. 

[0087] Such a user command is interpreted by the main control section B1 and patterns to determine the conditions 



9 



BNSDOCIO. <EP 



.1 084943 A2 l_> 



EP 1 084 943 A2 



and the motion of each of the components including the 2MP trajectory, the motion of the trunk, the motion of the upper 
limbs and the attitude and the height of the loins as derived from the motion of the feet (the soles to be more accurate) 
and that of the legs (Step S1 1). More specifically, the pattern of movement of the feet, the trajectory of the ZMR the pat- 
tern of movement of the trunk and that of the upper limbs are selected. Note that the motion of the loins is selected only 

5 in terms of the T direction and left unknown in terms of the X' and Y* directions. 

[0088] Then, the moment around the pitching axis and the one around the rolling axis (M x , M y ) on the selected ZMP 
that wiM be generated as a result of the motions of the feet, the trunk and the upper limbs are computationally deter- 
mined by using the linear and non-interference multiple material point approximation model (Step S12). 
[0089] Then, the moment on the selected ZMP that will be generated as a result of the horizontal plane motion of 

10 the loins (r' hx , r J hy ) is computationally determined also by using the linear and non-interference multiple material point 
approximation model (Step S13). 

[0090] Thereafter, the balancing formula for the moments on the selected ZMP are derived on the moving coordi- 
nate system O'-X'Y'Z* that moves with the robot (Step S14). More specifically, the moments (M x , M y ) generated as a 
result of the motions of the feet, the trunk and the upper limbs are used at the right side as terms of known variables 
15 and the terms on the horizontal plane motion of the loins (r hx , r hy ) are placed at the left side as terms of unknown vari- 
ables to derive a linear and non-interference ZMP equation (1) below. 

[mathematical expression 2] 

20 [0091] 

+ m h H (*"h X + r qx + g x )- m h g z (r' hx - r' zmp ) = -M y (t) (1) 
' ""hWhy + r qy + 9 y ) + ™ h g z (r* hy - r\ mp ) = - M x (t) 

25 

[0092] Note, however, it is assumed that the following equations hold true, 
[mathematical expression 3] 
30 [0093] 

r hz = 0 

hz + r qz - constant (in terms of time) 

35 

[0094] Then, the horizontal plane trajectory of the loins is computationally determined by solving the ZMP equation 
(1) (Step S15). For example, the ZMP equation (1) can be solved by using a known method such as Euler's method or 
a Runge/Kutta method to obtain the numerical solution for the horizontal absolute position (r nx , r ny ) of the loins as rep- 
resented by the unknown variables (Step S16). The numerical solution obtained here is an approximate solution for the 
40 motion pattern of the loins that allows the robot to walk in a stable manner, which represents the horizontal absolute 
position of the loins that allows the ZMP to get to the target position. The target position of the ZMP is normally selected 
on the sole when the latter touches the floor. 

[0095] If the preselected motions of the trunk and the upper limbs cannot be realized by the computationally 
obtained approximate solution, the patterns of motion of the trunk and the upper limbs are selected again or modified 

45 (Step S1 7). At this time the trajectory of each of the knees may also be computationally determined. 

[0096] Then, the pattern of movement of the entire body obtained in a manner as described above is used for sub- 
stitution in order to computationally determine the moments (eM x> eM y ) on the selected ZMP of the strict model (com- 
prising a rigid body or a large number of material points of the robot 100) (Step S18). While it is assumed that the 
equations of [mathematical expression 3] hold true for the non-strict model, the strict model does not require such an 

so assumption (and hence the latter equation does not need to be constant in terms of time). 

[0097] The moments (eM x , eM y ) of the strict model represent the errors in the moments generated as a result of 
the motion of the loins. Then, in the next step of Step SI 9, it is determined if the moments (eM x , eM y ) are less than the 
respective admissible values (eM x , eM y ) of the approximate moments of the non-strict model or not. If they are less than 
the respective admissible values, it means that the strict solution is obtained for the pattern of stable motion of the loins 

55 and hence a pattern of movement of the entire body can be obtained for a stable walk of the robot (Step S20) so that 
the processing routine is terminated. 

[0098] If, on the other hand, the moments (eM x , eM y ) are not less than the respective admissible values (eM x , eM y ) 
of the approximate moments of the non-strict model, the generated moments of the approximation model are modified 
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by using the moments (eM x , eM y ) of the strict model (Step S21) to derive a linear and non-interference ZMP equation 
once again. The above computational determination of the approximate solution of the pattern of movement of the loins 
and the subsequent modification will be repeated until the moments are found to be less than the respective admissible 
values. 

5 [0099] In short, with the sequence of operation of FIG. 6, a motion of the loins adapted to a stable walk can be real- 
ized in addition to that of the feet on the basis of the selected patterns of motion of the trunk and the upper limbs. The 
motion of the trunk and that of the upper limbs correspond to the action including a gesture, or the gait, of the upper 
body half of the robot 1 00. Since the attitude of the legs or the "gait" of the lower limbs is unequivocally defined, by the 
positions of the feet 22R/L and the horizontal position and the height of the loins in the case of a bipedal ambulatory 

ic robot 1 00 having six degrees of freedom at each of the legs (see FIG. 3), the generation of the pattern of movement of 
the loins means that the "gait" of the lower limbs is determined. 

[0100] Thus, with the bipedal ambulatory robot 100 adapted to erect bipedalism of this embodiment, it is possible 
to determine the gait of the lower limbs good for a stable walk regardless if the robot is standing upright or walking on 

the two feet, 

is [0101 ] Particularly when the robot 1 00 is made to gesture by using the upper limbs and the trunk while it is standing 
upright, it is possible to determine the gait of the lower limbs adapted to a stable walk that follows (and correct the unbal- 
anced condition of the upper body half). In other words, the stability of attitude that is lost by the gesture where the 
upper body half takes a major role can be appropriately recovered by determining a gait that is defined in terms of the 
horizontal position of the loins. 

20 [0102] FIG. 7 is a flow chart of another sequence of operation for controlling the motion of the loins adapted to sta- 
ble walk of a humanoid robot 1 00. 

[0103] Note that the motion and the position of each of the joints of the robot 1 00 are also described hereinafter by 
using a linear and non-interference multiple material point approximation model. 

[0104] The sequence of operation of FIG. 7 starts when a user command is input for an action of the robot 100, 
25 which may be a walking motion or a gesture. The action of the robot 100 as directed by the user command may be a 
gesture using the upper limbs and the trunk when the robot is standing upright, a walk on the two feet or a gesture using 
the upper limbs and the trunk when the robot is walking on the two feet to name a few. 

[0105] Such a user command is interpreted by the main control section 81 and patterns to determine the conditions 
and the motion of each of the components including the ZMP trajectory, the motion of the trunk, the motion of the upper 
30 limbs and the attitude and the height of the loins as derived from the motion of the feet (the soles to be more accurate) 
and that of the legs (Step S31 ). More specifically, the pattern of movement of the feet, the trajectory of the ZMP, the pat- 
tern of movement of the trunk and that of the upper limbs are selected. Note that the motion of the loins is selected only 
in terms of the Z' direction and left unknown in terms of the X' and Y' directions. 

[0106] Then, the moment around the pitching axis and the one around the rolling axis (M x , M y ) on the selected ZMP 
35 that will be generated as a result of the motions of the feet, the trunk and the upper limbs are computationally deter- 
mined by using the linear and non-interference multiple material point approximation model (refer to the above descrip- 
tion and FIG. 5) (Step S32). 

[0107] Then, the horizontal plane motion of the loins (r^, r^) is subjected to a Fourier series development (Step 
S33). As is well known to those who are skilled in the art, the time axis component can be replaced by a frequency com- 
40 ponent as a result of the Fourier series development. In other words, the motion of the loins can be expressed as a peri- 
odical movement. Additionally, the computational speed of this embodiment can be remarkably raised because FFT 
(Fast Fourier Transform) can be applied. 

[0108] Then, the moments (M x , M y ) around the pitching axis and the rolling axis on the selected ZMP are also sub- 
jected to a Fourier series development (Step S34). 

45 [0109] Then, the Fourier coefficients of the horizontal plane trajectory of the loins are determined and an inverse 
Fourier series development is carried out (Step S 35) to obtain an approximate solution of the motion of the loins (Step 
S36). The numerical solution obtained here is an approximate solution for the pattern of movement of the loins that 
allows the robot to walk in a stable manner, which represents the horizontal absolute position of the loins that allows the 
ZMP to get to the target position. The target position of the ZMP is normally selected on the sole when the latter touches 

so the floor. 

[0110] If the preselected motions of the trunk and the upper limbs cannot be realized by the computationally 
obtained approximate solution, the patterns of motion of the trunk and the upper limbs are selected again or modified 
(Step S37). At this time the trajectory of each of the knees may also be computationally determined. 
[0111] Then, the pattern of movement of the entire body obtained in a manner as described above is used for sub- 
55 stitution in order to computationally determine the moments (eM x , eM y ) on the selected ZMP of the strict model (com- 
prising a rigid body or a large number of material points of the robot 100) (Step S38). While it is assumed that the 
equations of [mathematical expression 3] hold true for the non-strict model, the strict model does not require such an 
assumption (and hence the latter equation does not need to be constant in terms of time). 
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[0112] The moments (eM x , eM y ) of the strict model represent the errors in the moments generated as a result of 
the motion of the loins. Then, in the next step of Step S39, it is determined if the moments (eM x , eM y ) are less than the 
respective admissible values (eM x , eM y ) of the approximate moments of the non-strict model or not. If they are less than 
the respective admissible values, it means that the strict solution is obtained for the pattern of stable motion of the loins 
5 and hence a pattern of movement of the entire body can be obtained for a stable walk of the robot (Step S40) so that 
the processing routine is terminated. 

[0113] If, on the other hand, the moments (eM x , eM y ) are not less than the respective admissible values (eM x , eM y ) 
of the approximate moments of the non-strict mode!, the generated moments of the approximation model are modified 
by using the moments (eM x , eM y ) of the strict model (Step S41 ) to carry out a Fourier series development once again. 

10 The above computational determination of the approximate solution of the pattern of movement of the loins and the sub- 
sequent modification will be repeated until the moments are found to be less than the respective admissible values. 
[0114] It may be clear to those who are skilled in the art that a motion of the loins adapted to a stable walk can be 
realized by following the sequence of operation of FIG. 7. Particularly, a periodical motion can be defined quickly by 
using a Fourier series development without relying of the method of obtaining numerical solutions of a ZMP equation. 

15 Additionally, the computational speed can be remarkably raised by applying FFT (Fast Fourier Transform). 

[0115] The motion of the trunk and that of the upper limbs correspond to the action including a gesture, orthe gait, 
of the upper body half of the robot 100. Since the attitude of the legs or the "gait" of the lower limbs is unequivocally 
defined by the positions of the feet 22R/L and the horizontal position and the height of the loins in the case of a bipedal 
ambulatory robot 100 having six degrees of freedom at each of the legs (see FIG. 3), the generation of the pattern of 

20 movement of the loins means that the "gait" of the lower limbs is determined. 

[0116] Thus, with the bipedal ambulatory robot 100 adapted to erect bipedalism of this embodiment, it is possible 
to determine the gait of the lower limbs good for a stable walk regardless if the robot is standing upright or walking on 
the two feet. 

[0117] Particularly, when the robot 100 is made to gesture by using the upper limbs and the trunk while it is standing 
25 upright, it is possible to determine the gait of the lower limbs adapted to a stable walk that follows. In other words, the 
stability of attitude that is lost by the gesture where the upper body half takes a major role can be appropriately recov- 
ered by determining a gait that is defined in terms of the horizontal position of the loins. 

[Annex] 

30 

[0118] The present invention is described in detail by way of specific embodiments. However, it may be clear to 
those skilled in the art that the above embodiments can be modified and/or altered without departing from the scope of 
the invention. 

[0119] While that attitude (0 hx , e hy , e hz ) of the loins of the robot is expressed above in terms of three degrees of free- 
35 dom of the trunk pitching axis 5, the trunk rolling axis 6 and the trunk yawing axis 7, the position of the loins of a human- 
oid robot 100 may be handled in various different ways by referring to the bodily mechanism of an actual bipedal 
ambulatory animal adapted to erect bipedalism such as man or ape. 

[0120] Additionally, the embodiments of the present invention are not limited to manufacturing products that are 
called as "robot". An embodiment may be applied, for example, to the products which are mechanical apparatus and 
40 mimic the behaviour of man by means of electric and/or magnetic effects. Examples of such products may be toys. 
[0121] In short, the present invention is described in terms of specific embodiments only to make it clearly under- 
stood and therefore the above embodiments by no means limit the scope of the invention. 

[0122] For the purpose of better understanding of embodiments of the present invention, the configuration of a joint 
model that can be used for humanoid robots is illustrated in FIG. 9. Referring to FIG. 9, the part of the robot covering 

45 the shoulder joints 5, the upper arms 3, the elbow joints 6, the forearms 4, the wrist joints 7 and the hands 8 are referred 
to as "upper limbs" 17. The part of the robot extending from the hip joints 1 1 to the trunk joint 10 is referred to as "trunk" 
1 8. The trunk joint 1 0 has the role of expressing the degrees of freedom of the spine of man. Finally, the part of the robot 
covering the hip joints 1 1, the thighs 12, the knee joints 14, the shanks 13, the ankle joints 15 and the feet 16 are 
referred to as "lower limbs" 19. More roughly, the part from-the-trunk-joint above is called "upper body half while the 

50 remaining part is called "lower body half. 

[0123] FIG. 10 is a schematic illustration of another joint model that can be used for humanoid robots. This model 
differs from that of FIG. 9 in that it does not comprise a trunk joint 10. Refer to the above description for the denomina- 
tions of the various components. The lack of a trunk joint that corresponds to the spine of man make the upper body 
half of the humanoid robot less rich in expressions. However, such a robot may find application in dangerous works and 

55 other works in industries where the motion of the upper body half is not particularly important. Note that the reference 
numerals of FIGS. 9 and 10 do not agree with those used in the other drawings. 
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Claims 

1 . An ambulation control apparatus for controlling a robot of the type haying at least lower limbs, a trunk and loins and 
adapted to bipedalism; 

5 

said apparatus being adapted to obtain the pattern of movement of the entire body for walking by deriving the 
pattern of movement of the loins from an arbitrarily selected pattern of movement of the feet, the trajectory of 
the ZMR the pattern of movement of the trunk and that of the upper limbs. 

10 2. An ambulation control apparatus for controlling a robot of the type having at least lower limbs, a trunk and loins so 
as to make it move on its two feet of the lower limbs in order to cause the ZMPto get to a target position, said appa- 
ratus comprising: 

(a) a means for selecting the motion of the feet, that of the trunk and that of the upper limbs and the attitude 
is and neight of the loins in order to realize a requested action; 

(b) a means for selecting the trajectory of the ZMP on the basis of the motion of the feet selected by said means 

(a); 

(c) a means for obtaining a solution for the motion of the loins for balancing the moment on the ZMP selected 
by said means (b); and 

20 (d) a means for realizing the motion of the loins on the basis of the obtained solution for the motion of the loins. 

3. An ambulation control apparatus for controlling a robot of the type having at least lower limbs, a trunk and loins so 
as to make it move on its two feet of the lower limbs in order to cause the ZMP to get to a target position, said appa- 
ratus comprising: 

25 

(A) a means for selecting the motion of the feet, that of the trunk and that of the upper limbs and the attitude 
and height of the loins in order to realize a requested action; 

(B) a means for selecting the trajectory of the ZMP on the basis of the motion of the feet selected by said 

means (A); 

30 (C) a means for obtaining an approximate solution for the motion of the loins for balancing the moment on the 

ZMP selected by said means (B) by means of a non-strict model; 

(D) a means for obtaining an approximate solution for the motion of the loins for balancing the moment on the 
ZMP selected by said means (B) by means of a non-strict model; 

(E) a means for finalizing the solution for the motion of the loins when the difference between the approximate 
35 solution obtained by said means (C) and the approximate solution obtained by said means (D) is less than a 

predetermined admissible value; 

(F) a means for modifying the moment on the ZMP of the non-strict model and inputting the modified value to 
said mean (C) when the difference between the approximate solution obtained by said means (C) and the 
approximate solution obtained by said means (D) is not less than the predetermined admissible value; and 

40 (G) a means for realizing the motion of the loins on the basis of the obtained solution for the motion of the loins. 

4. An ambulation control apparatus according to claim 3, wherein said non-strict model is an linear and/or non-inter- 
ference multiple material point approximation model for robots; and wherein 

45 said strict model is a rigid body model or a non-linear and/or interference approximation model of a multiple 

material point system. 

5. An ambulation control apparatus according to claim 3, further comprising: 

so (C) a means for reselecting/modifying the pattern of movement of the trunk and that of the upper limbs when 

the selected motion of the trunk and that of the upper limbs cannot be realized by the approximate solution 
obtained by said means for obtaining an approximate solution for the motion of the loins by means of a non- 
strict model (C). 

55 6. An ambulation control apparatus according to claim 3, wherein said means for obtaining an approximate solution 
for the motion of the loins by means of a non-strict model (C) is a means for obtaining an approximate solution for 
the motion of the loins by solving a balancing equation of the moment on the selected ZMP generated by the 
motions of the feet, the trunk and the upper limbs and the moment on the ZMP generated by the horizontal plane 
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motion of the loins. 

7. An ambulation control apparatus according to claim 3, wherein said means for obtaining an approximate solution 
for the motion of the loins by means of a non-strict model (C) is a means for replacing the time function with a fre- 

5 quency function for computation. 

8. An ambulation control apparatus according to claim 3, wherein said means for obtaining an approximate solution 
for the motion of the loins by means of a non-strict model (C) is a means for computationally determining the Fourier 
coefficients of the horizontal plane trajectory of the loins by applying a Fourier series development to the moment 

10 on the selected ZMP generated by the motions of the feet, the trunk and the upper limbs and also to the horizontal 

plane trajectory of the loins and additionally obtaining an approximate solution of the motion of the loins by applying 
an inverse Fourier series development. 

9. An ambulation control apparatus for controlling a robot of the type having an upper body half provided with a plu- 
15 rality of joints for expressing an action of the upper body half and a lower body half having leg joints at least for real- 
izing an ambulatory action, the gait of the lower body half adapted to stable walk being determined according to the 
gait of the upper body half. 

10. An ambulation control method for controlling a robot of the type having at least lower limbs, a trunk and loins and 
20 adapted to bipedalism; 

said method being adapted to obtain the pattern of movement of the entire body for walking by deriving the pat- 
tern of movement of the loins from an arbitrarily selected pattern of movement of the feet, the trajectory of the 
ZMP, the pattern of movement of the trunk and that of the upper limbs. 

25 

1 1 . An ambulation control method for controlling a robot of the type having at least lower limbs, a trunk and loins so as 
to make it move on its two feet of the lower limbs in order to cause the ZMP to get to a target position, said method 
comprising: 

30 (a) a step of selecting the motion of the feet, that of the trunk and that of the upper limbs and the attitude and 

height of the loins in order to realize a requested action; 

(b) a step of selecting the trajectory of the ZMP on the basis of the motion of the feet selected in said step (a); 

(c) a step of obtaining a solution for the motion of the loins for balancing the moment on the ZMP selected in 
said step (b); and 

35 (d) a step of realizing the motion of the loins on the basis of the obtained solution for the motion of the loins. 

12. An ambulation control method for controlling a robot of the type having at least lower limbs, a trunk and loins so as 
to make it move on its two feet of the lower limbs in order to cause the ZMP to get to a target position, said method 

comprising: 

40 

(A) a step of selecting the motion of the feet, that of the trunk and that of the upper limbs and the attitude and 
height of the loins in order to realize a requested action; 

(B) a step of selecting the trajectory of the ZMP on the basis of the motion of the feet selected in said step (A); 

(C) a step of obtaining an approximate solution for the motion of the loins for balancing the moment on the ZMP 
45 selected in said step (B) by means of a non-strict model; 

(D) a step of obtaining an approximate solution forthe motion of the loins for balancing the moment on the ZMP 
selected in said step (B) by means of a non-strict model; 

(E) a step of finalizing the solution for the motion of the loins when the difference between the approximate 
solution obtained in said step (C) and the approximate solution obtained in said step (D) is less than a prede- 

50 termined admissible value; 

(F) a step of modifying the moment on the ZMP of the non-strict model and inputting the modified value to said 
step (C) when the difference between the approximate solution obtained in said step (C) and the approximate 
solution obtained in said step (D) is not less than the predetermined admissible value; and 

(G) a step of realizing the motion of the loins on the basis of the obtained solution for the motion of the loins. 

55 

13. An ambulation control method according to claim 12, wherein said nonstrict model is a linear and/or non-interfer- 
ence multiple material point approximation model for robots; and wherein 
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said strict model is a rigid body model or a non-linear and/or interference approximation model of a multiple 
material point system. 

14. An ambulation control method according claim 12, further comprising: 

5 

(C) a step of reselecting/modifying the pattern of movement of the trunk and that of the upper limbs when the 
selected motion of the trunk and that of the upper limbs cannot be realized by the approximate solution 
obtained in said step of obtaining an approximate solution for the motion of the loins by means of a non-strict 
model (C). 

10 

15. An ambulation control method according to claim 12, wherein said step of obtaining an approximate solution for the 
motion of the loins by means of a non-strict model (C) is a step of obtaining an approximate solution for the motion 
of the loins by solving a balancing equation of the moment on the selected ZMP generated by the motions of the 
feet, the trunk and the upper limbs and the moment on the ZMP generated by the horizontal plane motion of the 

is loins. 

16. An ambulation control method according to claim 12, wherein said step of obtaining an approximate solution for the 
motion of the loins by means of a non-strict model (C) is a step of replacing the time function with a frequency func- 
tion for computation. 

20 

17. An ambulation control method according to claim 12, wherein said step of obtaining an approximate solution for the 
motion of the loins by means of a non-strict model (C) is a step of computationally determining the Fourier coeffi- 
cients of the horizontal plane trajectory of the loins by applying a Fourier series development to the moment on the 
selected ZMP generated by the motions of the feet, the trunk and the upper limbs and also to the horizontal plane 

25 trajectory of the loins and additionally obtaining an approximate solution of the motion of the loins by applying an 

inverse Fourier series development. 

18. An ambulation control method for controlling a robot of the type having an upper body half provided with a plurality 
of joints for expressing an action of the upper body half and a lower body half having leg joints at least for realizing 

30 an ambulatory action, the gait of the lower body half adapted to stable walk being determined according to the gait 

of the upper body half. 
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(54) Robot ambulation control apparatus and method 



(57) The stability of attitude of a robot can be recov- 
ered by an ambulation control apparatus and an ambu- 
lation control method if it is lost in the course of a gesture 
for which the upper limbs take a major role. The appa- 
ratus and the method obtain the pattern of movement of 
the entire body for walking by deriving the pattern of 
movement of the loins from an arbitrarily selected pat- 
tern of movement of the feet, the trajectory of the ZMP, 
the pattern of movement of the trunk and that of the up- 



per limbs. A robot can determine the gait of the lower 
limbs so as to realize a stable walk regardless if the robot 
is standing upright or walking. Particularly, If the robot is 
made to gesture, using the upper body half including the 
upper limbs and the trunk while standing upright, it can 
determine the gait of the lower limbs so as to make a 
stable walk in response to such a gait of the upper body 
half. 
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